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Abstract. Using elementary methods, we prove that for a countable Markov 
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isfies certain conditions of asymptotic decay. An example, modelling a renewal 
process and providing a markovian approximation scheme in dynamical system 
theory, is worked out in detail, illustrating the relationships between conver- 
gence behaviour, analytic properties of the generating functions associated to 
transition probabilities and spectral properties of the Markov operator P on the 
Banach space ii. Explicit conditions allowing to obtain the actual asymptotics 
for the rate of convergence are also discussed. 
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0. INTRODUCTION. 

Let 5 be a countable set and P : S x S ^ [0,1] he a transition probability- 
matrix. With no loss we may set S = IN. We shall assume that P governs an 
irreducible, recurrent and aperiodic Markov chain X = {xn)o^ with state space 
S. To be more precise, we set INq := IN L) {0} and let denote the subset 
of given by all sequences uj = {uJi)i^]is[Q which satisfy for any integer i: 
Pu!iU!i+i = -P(<^i)<^i+i) > 0. For any n e INq we let Xn be the projection on the 
n^^ coordinate, i.e. Xn{oj) = ojn- Let moreover Pj^ be the probability measure 
with initial distribution u (that of xq) on Q, i.e. 

PA^niio) = j} = E ^^^'S- = i^P^j (0.1) 

where pfj = P^'^^ (z, j). Our sample space will be f2 equiped with the restriction of 
the product cr-field and with probability measure Pt/ for some initial distribution 
V. We shall denote by E^, the expectation w.r.t. Pjy. In particular, ii f — 
where i is some reference state chosen from the outset, we have 

^i{Xn{^) = j] = ^{Xn{i^) = j\xo{io) = i} = p^j. (0.2) 

Let rrii be the P^-expectation of min{n G -CVq, Xn{uj) = i}, the time of the first 
visit at i. It is well known (see e.g. [Chu]) that if P is irreducible and aperiodic 
then 

hm pf^ = — , (0.3) 

n— s-oo ■' rrii 

where the r.h.s. is taken to be zero in the transient and null recurrent cases 
when rrii = oo. If instead rrii is finite for some (and hence for all) i & S then P 
is called ergodic, or positive recurrent, and there is a (unique) probability dis- 
tribution TT on 5 given by tt = {'Ki)'^' = (l/mj)i° which is a solution to tt = ttP 
and thus defines a stationary distribution. This paper is devoted to the study 
of the rate of convergence in (0.3) for ergodic chains and more generally to the 
rate convergence of a given initial distribution to the stationary distribution 
TT. It is divided into two main parts. In the first part (Sections 1 and 2) general 



convergence results are stated and proved, which relate the rate of convergence 
to a parameter d called the ergodic degree. Roughly speaking, the ergodic degree 
controls in a continuous fashion the number of finite moments possessed by the 
time of the first visit at a given state i e S (see Defintion 1). The fact that 
the speed of convergence for countable state Markov chains is connected to the 
number of moments of first passage times has been put forward by several works 
starting with Feller [Fel]. In particular, using the technique of coupling. Pitman 
[Pi] proved that if first passage times have finite r-th moment, with r a given 
positive integer with r > 2, then the rate of convergence in (0.3) is o(n~^'^~^^). 
For other results of the same nature we refer to [Pop] and [TT]. In Theorem 1 
stated below an improvement of the above results is achieved in that for any 
real positive value of the ergodic degree d, which is assumed to be finite, it is 
possible to prove subgeometric convergence to equilibrium of order n~'^. This 
amounts to obtaining subgeometric lower bounds as well, which are here proved 
using elementary generating functions techniques. The relevance of obtaining 
sharp bounds is further discussed in Section 3, where an example modelling a 
renewal process is worked out in detail using a different (although similar in 
spirit) method which makes use of matrix- valued analytic functions and allows 
to further sharpen the general results of Section 1 under suitable conditions. 
The main motivation is that of illustrating the relationships between conver- 
gence behaviour, analytic properties of the generating functions associated to 
transition probabilities and spectral properties of the Markov operator P on the 
Banach space £i. A second motivation is discussed in the Appendix and comes 
from the fact that this example provides a markovian approximation scheme in 
dynamical system theory, where the question of obtaining sharp subgeometric 
bounds for the decay of correlations appears to be particularly relevant (see [Isl] 
and [Sa]). 
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1. ERGODIC DEGREE AND GENERAL CONVERGENCE RE- 
SULTS. 

In the sequel we identify sequences v = {I'i)'^ G ^i(<S'), the corresponding row 
vectors v — {i'i^i'2i ■ ■ ■)■, and finite signed measures on 5, and define 



i=l 



A signed measure v satisfying ^ = 1 wiU be called a signed distribution. 
Similarly, we shall identify sequences u = (tti)i° G £oo{S), the corresponding 
column vectors u = (tti, U2, ■ ■ .)*, and bounded functions on S. 
We introduce the classical taboo quantities: 

fij = ^ j,0 < I < n, Xn{u)) = j I xo{u) = i}, 

kPij = P{a;/M 7^ A;, < Z < n, Xn{uj) = j \ xo{(jj) = i}, 



n=l n=l 



Clearly jp^^ = J^". Since we have a unique recurrent class, f*^ = 1 for all i,j e S. 
Moreover, for an ergodic chain we have ([Chu], Chap. L9, Thm. 5) 

lim ^^ = ^=.K,- (1-1) 

The last quantity can also be viewed as the Pj-mean number of visits to the 
state j before return to i. The relation between the /^j's and the transition 
probabilities Pij is given by ([Chu], Chap. 1.5, Thm. 2) 



Ptj '^iji Ji] ^ 

and 

n 

p^^-Y.fipii'- (1-2) 
fe=i 

We also have 

l^n=l "'Jii 
4 



For k e M, i E S, let t^*'' be the time of the k-th entrance into state i, and let 

rl:\u;) = t^l-t^\ k>0 (1.4) 

be the sequence of times between returns (set — 0). Clearly we have Tq^ > 
and r^*-* > for /c > 1. Moreover, the state i being recurrent, r^\r2 \ • • • are 
i.i.d. random variables under the probability Pj. Their common distribution is 
given by 

P,{r«(u;)=n} = /- k>l. (1.5) 

On the other hand, having fixed an initial distribution v and a reference state 
i, the random variable (the delay in the embedded renewal process) is dis- 
tributed according to P,^. More specifically. 



Pj^{^o =n} = Ui 5no + ^ i^ifi 
For 7 > 0, i, J e 5 (and A; > 1), we set 

oo 

r(7) ._ T^..njj) 



Mi7^:=E^(|ri^V) = E^"/5- (1-6) 



n=l 



Notice that nii = M-p . Given a signed distribution i/ on S, we also set, 

oo 

Ijti n=l l^i 

The next result extends ([KSK], Thm. 9.65) to arbitrary (i.e. not necessarily 
integer) 7- values. 

Lemma 1. If 7 > 0, then M^+^^ < 00 ii and only ii M^^^ < 00. 

Proof. Using the last identity in (1.1) and the decomposition iP^j^'^ = ^i^i iPuiPu 
we get 

00 00 

A^i? = E E ^'//^ = E E ^if^ 

n=l l^i n=l l^i 



00 

+m 



= TT, E E E ^puiPii = E E 

n=l m=l l^i n=l m=l 

00 00 / n— 1 \ 

= 7r,E^"E/^ = ^^E E^' A'^ 



n=l m>n n—1 
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and we finish the proof by noting that Yl^=i ^ n^~^^ / (7 + 1) as n — > oo. <C> 

Remark. It is well known that, for a recurrent chain, if Mj;^'^^^ < 00 for some 
state i then M-J'^^'* < 00, for all pairs (distinct or not) i^jeS (see, e.g., [Chu], 
Chap. 1. 11, Cor. 1). Notice however that even though M^J'* < 00 for all i & S, 
the series X^ies ^i-^i-I'' is divergent. To see this, consider for example 7=1. 
Assuming Mj;f^ < 00 let us suppose that 

Then, since the double series has positive terms we would have 

I ij^l 

as well. But this is impossible because M-p + Mip = {l + ip*^)7r~^ ([Chu], p. 65) 
and lim^^oo (M^P/M^p) = for alU e 5 ([Chu], Chap. I.ll, Thm. 6; see also 
[HI]). 

We now state the following definition. 

Definition 1. Given a recurrent Markov chain P with state space S, the ergodic 
degree of P is the number 

d = inf{7 : M^^^^"*"^-* = 00 for some (and then for all) i & S } 

Notice that Mj^P = 1 so that the degree satisfies d > —1. In the following 
we shall refer to an ergodic chain as a chain for which d is strictly positive. 
If M^y^ < 00 for every 7, one says that P has infinite ergodic degree. This 
happens for instance if the coefficients fH decay geometrically with n. In this 
case the corresponding chain is accordingly called geometrically ergodic. We 
refer to [FMM] for related convergence results in the geometrically ergodic case. 
The preceeding observations and Lemma 1 motivate the next definition. 

Definition 2. Given an ergodic chain P with state space S and a signed distri- 
bution V on S, the P-order of v is the number 

sup{7 > : M^J-* < 00 for some (and then for all) z e /S } 
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Remark. Lemma 1 implies that the ergodic degree of an ergodic chain P 
coincides with the P-order of its stationary distribution tt. 

Notations: Here and in the sequel, for two sequences and bn we shall write 
On ~ bn if the quotient an/bn tends to unity as n — cxd. Moreover, the notation 
On = Oe{n~'^) means that an = o{n~^^~^^), Ve > 0, or, which is the same, that 
an ■ mf^ grows slower than any power of n as n ^ oo. This condition is satisfied 
if, for example, decays as C L{n) where L{n) is some function slowly 
varying at infinity, i.e. L{cn) ~ L{n) for every positive c. 

We now state the main result of this Section. 

Theorem 1. Suppose P has ergodic degree d > 0. Then, for any initial signed 
distribution v of P-order at least d, we have 

WuP'^-nW =Oe{n-'^). 

In addition, if Mj^f~^^^ = oo for some (and then for all) i and the P-order of v is 
strictly larger than d, then the above bound is sharp, i.e. ■ WuP'^ ~ '^W varies 
slower than any power of n. 

We let T be the shift transformation on 0,, that is Xk o t{(jj) = uJk+i- With P 
and TT one can define a r-invariant Markov random field fx = fi{P, tt) supported 
by f2 as follows: 

n 

We shall say that has ergodic degree d whenever P (and tt) has the same 
property. We then have the following. 

Corollary 1. Suppose jj, has ergodic degree d > 0. Then, for any pair of 
bounded vectors u,v : S ^ M, 

I ll(u{Xn)vixo)) - lliu{xo)) IJ,{v{xo)) \ = Oe{n~^) 
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2. PROOFS 

We shall prove Theorem 1 and its Corollary through several Lemmas. We start 
with few technical results which will be used several times in the sequel. 

Lemma A. (see, e.g., [Chu], Chap. L5) Let {an}n>o be a sequence of nonneg- 
ative numbers not all vanishing and such that an/ iYlm=o ^^n) — 0, n — > oo. 
Then, whenever the sequence {bn}n>o of real numbers has a limit, we have 

lim O^mbn-m ^ ^.^ 

Lemma B. Let D{z) = Xl^o "^n^" be absolutely convergent and D{z) ^ for 
\z\ < 1. Let moreover dn = Oe{n~'^) for some 7 > 1. Then 

^ CX) 

^ ^ n=0 

is also absolutely convergent for \z\ < 1 and Cn = Oe{n~^). The assertion 
remains valid if Oe{n~'^) is replaced by o{n~'^). 

If, in addition, do = 1, dn > and dn/dn-i is increasing, then cq = 1 and 
Sfc=o Cfc > decreases monotonically to D{1)~^ < 1. 

Proof The first statement is a consequence of a theorem of Wiener and its proof 
can be found in [Ro], Lemma S.H. For the last statement see, e.g., [H2], Thm. 
22. 

Lemma C. Let D{z) and C{z) be as in the first part of Lemma B with dn = 
Oe{n~'^) for some 7 > 1. Assume furthermore that dn > and J2 dn = 00. 
Given a sequence Cn, n> 0, let hn = X]fc=o '^'^ ^n-k, or else 

e z'^ 



rinZ - „oo , n' 
n=0 ^n=0 ^nZ 



(a) If Cn = O^i^^^^di) , then = O^iJ^iyndl); ^^Le assertion remains valid 
if Oe{J2e>n di) is replaced by o{Y.t>n ^i)- 

(b) If, in addition, = J2e>n ^^^^ ~ -0(1)"-^ e„. 



Proof. First, since dn — Oe{n~^) we have from Lemma B that = Oe{n~^) as 
well. To show (a) we then notice that 

n/2 n/2 

\hn\ < max |e„_fc| |cfc| + max IcfclV'lefcl. 

0<fc<n/2 n/2<fc<n 
- - ' fc=0 ' - - A:=0 

Therefore, if ^ \ek\ < oo then hn = 0(max{|c„|, |e„|}), otherwise hn = 0(e„). 
Indeed, the condition ^ |efe| = oo entails 1 < 7 < 2. Since dn = Oe{n~'^) and 
Cn = Oei^iy^di) = Oe(n~'''"''^), Lemma B implies that the last term in the 
r.h.s. of the above expression is 0^{n~'^^^~^'>) = o(^^^^ dg). 
Let us now prove assertion (b). Under the assumption stated there. Lemma 
A yields hn — ^^=o^k = o{Ylk=o^k) = o{l). But we can say more. The 
conditions dn > and '^n'^~^ dn = 00 imply that n'^~^ • e„ decays slower than 
any inverse power of n. Moreover, let us note that since e„ = X]^>n ^® have 
D(l) - Er=o = (1 - E~ enz". We then write 

The proof of (b) then reduces to show that the coefficients of the last power 
series are o(e„). To this end we use the following easily checked fact: 

f 0(^3-27)^ forl<7<2, 
^k}-^ {n - kf-^ = I 0(logn/n), for 7 = 2, 
fc=o \ O(ni-T), for 7 > 2. 

By the above, the coefficients of the power series (1 — z) (X^^o ^nz'^)^ are 
Oe(^i"^^^~^^) for 1 < 7 < 2 and Oe{n-^) for 2 < 7, therefore o{en) in both 
cases. The claim now follows by applying the same reasoning as in the proof of 
(a) to the coefficients of (1 - z) (S^o ^nz'^f Yln=Q CnZ"^ . 

In the following Lemma we shall establish an asymptotic equivalence which 
determines the speed of convergence of the diagonal transition probabilities 

to the stationary distribution TTj in terms of the Pj-distribution of the first return 

it) 

time r\ . This will be prove useful to obtain sharp bounds under appropriate 
conditions. 



Lemma 2. For a (Gnitely) ergodic chain P with state space S and stationary 
distribution tt, we have, for any i & S, 

1 
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J]P,{r«(a;)>n- 
Proof. We introduce the generating functions 

oc oo 

PiA^) = T.P^j z\ F.jiz) = J2 (2-1) 

n=0 n=0 

and from (1.2) we get the relations (we set = for n = 0) 

We first show that the function Pii{z) is analytic in |2;| < 1 and converges at 
every point of the unit circle besides z = 1. Indeed, recurrence of the state i 
implies Fail) = 1, so that |Fii(2;)| < 1 for \z\ < 1 because > 0. Moreover, 
|-^ii(-s)| < 1 also for 1^1 = 1, z 7^ 1. This follows from the fact that, since the 

chain is aperiodic, g.c.d.{n, /?J 7^ 0} = 1. Now set 

00 

Du{z) = J2 ^ ■= E fii = > ^} (2-3) 

n=0 k>n 

and notice that Dii{z) converges absolutely in |2;| < 1 and has no zeros on 1^1 = 1. 
In addition X^^o^lr"* = '"^i- 1^ then follows from Lemma B that the function 

-J— = {1 - z)Pu{z) (2.4) 

has a power series expansion which converges absolutely in the closed unit disk 

and, moreover, its value at 2; = 1 is = TTj. Set 

^00 00 

i^-E4"'-", Ei4"'i<-. (2.5) 

We now observe that the ergodicity assumption implies that d^^^ = Pi{ri\uj) > 
n} = o{n~^). We may then use again Lemma B to obtain c^^^ = o{n~^) as well. 
By an Abelian theorem (see, e.g., [Chu], p. 55 ) we then have 



n 



pS = E4'^^^^. r^^oc. (2.6) 

fc=0 
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To obtain more information, we first observe that mj — 1 is the coefficient of 
2;" in 

Huiz) := rui P,i{z) - = |44 (2-7) 

i — z L>ii{z) 

where 

Eu{z) = J2e^z-, := ^ J2^^{r['\u;) > i}. (2.8) 

n=0 e>n i>n 



Now, if the ergodic degree d is finite the conditions of Lemma C-(b) are satisfied 
for the sequences , ci^^ and ei^^ . Whence we conclude that 



iPl-^i) - J2^i{r['\u;)>e}. (2.9) 



This finishes the proof. <() 

Lemma 3. Suppose Mj^^^ < 00 for some (and hence for all) i & S and for some 
7 > 1. Then, 

||5iP"-7r|| = o(n-(^-^>). 

Proof. We start noticing that the assumption Mj^^'^ < 00 implies Pi{ri\u)) > 
n} = o{n~'*) and therefore, by Lemma 2, we have 

|pS-7ri| = o(n-(^-i)). (2.10) 

More generally, it follows from (1.2), = 1 and and Lemma A that pfj ttj 

as n — > 00. Furthermore, as already remarked, the condition Mj^^^ < 00 implies 
that X^^i n^fij < for all pairs (distinct or not) i,j e S. This and Lemma 
A, along with the inequality 

n 

ip'^-^ji < E/5 \pli'-^j\+^j E/£' (2.11) 

k=l k>n 

imply that the rate of convergence to zero of — TVj \ is the same as in (2.10). 
These properties entail that tends to the matrix whose rows are (tti, 7r2, . . .). 
To finish the proof we proceed as follows. Having fixed a state k E S we use 
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(1.1) along with standard decomposition formulae (see [Chu], Chap. 1.9) to write 
Pij - as 

n — 1 oo 

p2j - = E ''P" (pTk - ^k) + kP^, -^kJ2 '^Pkj = 1 + 11 + III- 

m=l m=n 

Recalling that kPfj = ^rn>n flk summing over j e S we immediately 
obtain Ylj^s l^l ~ o(n~'^) and Ylj^s \m\ ~ o(n~^'^~^'>). For the first term we 
have 

n-l 

j€S m=l r>n—m 

Let us multiply both sides of the above inequality by n^"'~^\ Using the fact that 
n < m{n + 1 — m) if 1 < m < n we get 



n— 1 n— 1 



-'J2\PTk-^k\ E fkk<T.\PTk-^k\m'r-' Yl fkin + l-mr-K 



m=l r>n—m m=l r>n—m 



Since limp^oo(p + 1)'^""^ J2r>pfkk = ^ and lim^^oo - 'JTk\m'^~^ = 0, from 
Lemma A it follows that the r.h.s. tends to zero as n — > oo and therefore 
|/| = o{n~^^~^^). We have thus found that 

ElpS-^.-|=o(n-(^-^)) 

and the proof of Lemma 3 is complete. 

Lemma 4. For any initial signed distribution v such that Mj)l~^'' < oo for some 
(and hence for all) i e S (and 7 > Ij and under the hypotheses of Lemma 3, we 
have 

||iyP"-7r|| =o(n-(^-^)). 

Proof. Putting u = J2 using the fact that 1/ is normalized, i.e. ^ z/^ = 1, 

we write 

ivP" - TT = ^ {S,P^ - Tt) + ^ {6iP^ - S^P^) 

' (2.15) 
= {5iP^-7r) + Y,^iiSiP^-SiPn- 
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The £i-norm of the first term in the r.h.s. is then estimated by Lemma 3. For the 
second term we have \\5iP'^ — 5iP'^\\ = {pfj — Pij\- Using the decompositions 
P?j = iP?j + TVi ftiP^f' ([Chu], Chap. 1.9, Thm. 1) and p-- = Y^Vi fuP^ + 
E^n fliPij^ and noting that Y.j iPij = Efc>n fu and P7j = 1, we obtain 

oo n — 1 

k=n k=l j 

Thus, by (1.6), the norm of the last term in the r.h.s. of (2.15) is bounded by 

n-l 

l^i k>n k=l j 

The assumption that M^J < oo immediately implies that the first term in 
the above expression is o{n~^'^~^^). As far as the second term is concerned, we 
may use the inequality 

E \p^f' -pl\ ^ E W - + E \pl - ^.-1' 

i 3 3 

and it will suffice to estimate the expression 

n-l 

k=l j 

Now, the assumption mIJ~^^ < oo implies that lim/s^oo k'^~^Pi^{rQ^ = k} = 
and, under the assumptions of Lemma 3, lim^_»oo TnP'~^ Ej \P7j ~ — 0- 
may then repeat the argument given at the end of the proof of Lemma 3 to see 
that the above expression is o(n~^'^~^'^). <0> 

Proof of Theorem 1. The conditions on the ergodic degree of P and on the 
P-order of v imply that the assumptions of Lemmas 3 and 4 are satisfied for 
7 = (i + 1 — e, Ve > 0. This gives a rate of convergence ©(n"*^^"*^^), Ve > 0, 
that is Og(n~'^). But we can say more. Indeed, the condition E^'^^^/ii = °° 
and Lemma 2 entail that — T^i \ -n^, and thus \\5iP'^ ~ '^W " decays slower 
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than any inverse power of n. On the other hand, from the proof of Lemma 4 we 
see that the condition that v has P-order strictly larger than d implies that the 
norm of '^i^^ i^i {SiP'^ — SiP^) is Oe{n~'^'), for some d' > d. This prevents from 
possible cancellations among the two terms in the r.h.s. of (2.15). 

Remark. The proof given above brings out the meaning of the condition on 
the P-order of the initial distribution u. This is related to the fact that the 
behaviour of \pfj — tTj] and hence of ||5iP" — 7r|| is necessarily not uniform in 
the departing state index i. Indeed, according to the above discussion, such 
uniformity would imply the existence of two positive constant Ci,C2 and an 
integer no, which do not depend on i and /, such that, for all n >no 

^ , Z-^k>n J li ^ ^1 

This, in turn, would imply that the ratio /M^p satisfies a similar bound. 
On the other hand, as already observed, lim^^oo {^iP /^iP) — 0; ^or all i E S. 

Proof of Corollary 1. For any pair u e ioo{S), p G ^i('S') we define pu = 
(p(l)tt(l), p(2)tt(2), . . .) and p • u = J2ies Thus pu • 1 = p • u, and the 

unit column vector 1 = (1, 1, . . .)* satisfies PI = 1. For definiteness and without 

loss, suppose that /u(u) /u(v) 7^ 0. Then we have 

I l^{u{Xn)v{xo)) - n{u{xo)) n{v{xo)) \ = | TTvP'' • U - (tT • v) (tT • u) | 

= |(7fvP^-7r(7fv-l))-u| 

< ||u||oo ||v||oo II z^P" -7r|| 
where u denotes the normalized ii row vector ttv/ (tt ■ v). The result now follows 
putting together Lemma 1 and Theorem 1. <0 

3. CONVERGENCE VS ANALYTIC AND SPECTRAL PROPER- 
TIES. AN EXAMPLE. 

As we have seen, the dependence on the departing state i of the behaviour of 
ll^iP"^ — 7r||, although not explicitly indicated in Lemma 3, is what makes our 
assumptions on the P-order of the initial distribution u necessary. 
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Moreover, from our discussion it follows that the rate of convergence to zero of 
ll^jP"^ — 7r|| is connected with the analytic properties of the generating functions 
Pij{z) in the vicinity of the singular point z = 1. 

If we now consider P as a bounded linear Markov operator acting on the Banach 
space its adjoint P* is represented by the transposed matrix acting on the 

dual space £1 — loo- The resolvent R\{P) :— {XI — P)~^ admits, for |A| > 
the expansion 



which shows that 1 — 6ij + Pij{z) is the (z, j)-element of XRx{P), with the 
identification z = 1/X. This, in turn, indicates that the convergence properties 
of ll^iP"' — 7r||, the analytic properties of the functions Pij{z), and the spectral 
properties of P in £i{S) are intimately connected items. In particular, the 
dependence of the first two from the state index i plays an important role in 
determining nature of the latter, as we shall see in the following example^. 

Example. Suppose that S — IN and the transition matrix is 



The space Q is then given by all sequences oj satisfying the following condition: 
given coi then either coi-i = + 1 or uji^i = 1. We shall assume that the 
probability vector p = (pi,p2, • • •) has the property g.c.d.jn : pn > 0} = 1- It 
then follows that the corresponding chain is aperiodic and recurrent. Let the 
coefficients dn be defined by dn := X^j>„Pi5 {n > 0). The steady-state equation 
is TTn = Ylii^s^iPin ci^d is formally solved by 7r„ = TTidn-i, (n > 1). We 
also have /{\ = Pn- Consequently, the chain is positive-recurrent if and only 

We shall adopt the convention that a matrix (ty ) representing an operator T 
acts from the right, that is through the equations {Tx)j = X^igs-^^^y- 




P = 



(Pl P2 P3 

1 

1 

1 
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if ^(iri < oo, null-recurrent in the opposite case. In the former case, we have 
TTi = {Yl^=i''^Pn)~^ = {Yl'^=o d'n)~^ • Notice that the two probability vectors tt 
and p coincide if and only if pn = 2~"'. On the other hand, if pn ~ n"^'^^^^ L{n) 
with L{n) a suitable function slowly varying at infinity then the chain has ergodic 
degree d. 

Remark 1. It is not difficult to realize that the r-invariant Markov random 
field fi = fi{P,7r) defined in (1.8), with P and tt as above, can be viewed as an 
equilibrium state [Ru] for the continuous potential function V : 0, ^ M defined 
as 

V{u}) = logpa;o - logPu^i + logP(a;o,a;i). 

Remark 2. The Markov chain P is a reference model in renewal theory (see 
[Se]). In particular, the validity of the renewal limit theorem corresponds to the 
fact that the chain is ergodic. Several estimates on the remainder term in this 
limit theorem (which corresponds to the speed of convergence to equilibrium) 
have been obtained. See [Ro] for very accurate results and also [Se], Chap. 24, 
for a review. These results can be viewed as particular cases (corresponding to 
1^ = 51 and Uk = 5f, for some i e IN) of Theorem 2. Ill stated below. Moreover, 
this example has interesting applications in modelling renewal processes arising 
in dynamical system theory; a situation which has recently become a standard 
example being that of Markov interval maps modelling temporal intermittency 
(see, e.g., [Wa]). A brief discussion on the consequences of the results stated 
below in the context of dynamical systems theory is given in the Appendix at 
the end of the paper. 

Theorem 2. Suppose that the chain P defined above has Gnite ergodic degree 
d>Q. Then, 

I. The generating functions Pij{z) defined in (2.1) are analytic in the open unit 
disk. For < 1 the functions 1/Pij{z) have only one zero at z = 1 which is a 
non-polar singular point for Pij (z) . 
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II. The spectrum cr(P) of the Markov operator P acting on £i{lN) coincides with 
the closed unit disk and decomposes as foUows: (Jp{P) = {X : |A| < 1}U{1} 
and ac{P) = {A : |A| = l,Ay^ 1}. 
III. For any bounded vector u and any initial distribution v = (I'i)'^ G ii{S) s.t. 
Vi = 0{TVi), the quantity {uP^ — tt) ■ u decays as 0^{n~'^). 

Assume furthermore that pn ~ n~^^^'^^ L(n) with L{n) slowly varying at infinity 
and Ui = 0(1), Vi = 0(77^). Then we have 

(ivP"-7r)-u-Cn-'^L(n), 

withC= {n -ujiu ■l)/{d{d+l)mi). 

Remark 1. Statement / above holds for any aperiodic Markov chain with finite 
ergodic degree and is well known. On the other hand, it can be considerably im- 
proved by specifying further properties of the probability vector p. For instance, 
if the Pn form a monotonically decreasing sequence pi > P2 > ■ • ■ satisfying 
the Kaluza property: p^ > pn+iPn-i (with po = 1) then using the last part of 
Lemma B one can show that the generating functions Pij{z) can be continued 
meromorphically to the entire z-plane with a branch cut along the ray (1, +00) 
(see [Is2]). 

Remark 2. In the null-recurrent case {d < 0) the statements corresponding to 
II and III above are modified as follows (see [A]): 
//'. The spectrum ct{P) of the Markov operator P acting on £i{IN) coincides with 
the closed unit disk and decomposes as: crp{P) — {A : |A| < 1}, crc{P) — {A : 
|A| = 1, A ^ 1} and ar{P) = {!}. 
///'. Let V = {vi)f e ioo{S) be the unique (non-normalized) positive invariant vector 
for P with vi = 1 (see [De], Thm 1). Here Vn = dn-i- For any vector u e 
•^00 (-S") such that u • v < 00 and any initial distribution v e •^i(<S') we have 

zvP" - u^ (zv l)(u- v)p^i 

and Pii • varies slower than any power of n. 
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The proof of Theorem 2 wiU foUow from the points /, // and /// discussed 
hereafter. 

I. Generating functions. 

First, it is easy to check that all entries of the first n rows of are positive, 
the i-th row of P being the {i + n — l)-th of P^. More specifically, one sees 
inductively that for n > 1, z > 1, j e iV, 

P-{i,j) = P--\i-l,j). (3.1) 

For the generating functions of the j)'s we then obtain the relations 
Pij (z) = Sij + z'-'^ Pij (z), j>i>l 

Pa{z) = z'-'Piiiz), i>l (3.2) 

Pij{z) = z'-^ + ^'-'Pi,-(^), i > J > 1. 
It then suffice to study the behaviour of the entries of the first row. They satisfy 
the recurrence relations P''(l,i) = P^-^(l, 1) P(l, j) + P^-^l, j + 1), j >\ 
(recaU that P^{i,j) = 5^). This yields 

n-l 

P-(l,i) = J2 ^(1' ^) ^"""(1'^') + Pi^^J +n-l). (3.3) 
fc=i 

Putting j = I and recalling that P(l, k) — pk — /n one gets a particular case 
of equation (1.2). It hence follows that 

where D[z) = J2'^=o dnz'^- More generally, we get for j > I 

P,jiz) = z'-^Pjiz)P,,iz) (3.5) 

where Pj{z) = J2n^jPnz''. Finally, using (1.1)-(1.2) along with (3.2), (3.4) and 
(3.5) we obtain 

Fij{z) = z'-^, i>j, 

z'-^Pjjz) . . (3.6) 

^ l^OKnKjPnZ 
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Remark. As an application of the above formulas one can compute the moments 
M^^^^-* of P. For instance, if d > 1, computing the second derivative at 2; = 1 of 
Fii{z) yields 

where M^7^ = ^ rfpn and the last asymptotic equivalence holds for z ^ 00. 

The proof of the analytic properties of the generating functions {z) now fol- 
lows a standard path and we therefore omit it. 

11. Spectral properties of P : h{]N) h{IN). 

From (3.1)-(3.2) we have that the rate of convergence of P'^{i,j) to ttj is not 
uniform in the departing state i (see also the Remark after the proof of Theorem 
1). We are now going to see how this fact reflects in the nature of the spectrum 
of P in ii. In particular, the eigenvalue 1 is not isolated, even in the case where 
the PnS are exponentially decreasing. 

We study the structure of the spectrum of P using the method of generating 
functions (see, e.g., [VJ]). Setting x = {xi,X2., ■ ■ ■) and X{w) = X^^i ^nw'^ the 
formal solutions to the vector equations 

{XI -P)x = and (XI - P*)x = 

can be written as 

^ ^ 1-Xw ^ ^ 



and 



X{w)=-^p.^, (3.8) 
X — w 



respectively, where p ■ x. = '^^^iXnPn- The equation 1 — Xw = (and its 
reciprocal X — w — 0) entails that the boundary of cr(P) (and of a{P*)) is the 
unit circle. Let us first consider the point A = 1. The formal expressions in (3.7) 
and (3.8) become 

w 

X{w) = xiw D{w) and X{w) = p ■ x. (3-9) 

1 — w 
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The latter has the solution X{w) — w/{l — w) which is the generating function of 
the unit vector in i^Q- On the other hand, the former is the generating function 
of an £i-vector if and only if -D(l) < oo. Hence, we have that in the positive- 
recurrent case 1 lies in (Tp{P) (for the null- recurrent chain it lies in ar{P)). 

More generally, from (3.7) and (3.8) one sees that the open unit disc {A : |A| < 1} 
is always in the point spectrum. Indeed, the function (1 — w)D{w) = 1 — 
Y^^^iPnW^ appearing in (3.7) is absolutely convergent for \w\ < 1. If |A| < 1 
the same holds true for the function w/{l — \w) = Yl^=i X^~^w'^. Therefore the 
power series expansion of X{w), being the product of two absolutely convergent 
power series, is absolutely convergent at any point of the closed unit disk \ w\ < 1. 
More precisely, an easy calculation shows that for n > 2 the coefficient Xn of 
tu" is bounded above by |a;i| (lAI"^"-*^ + X]^=o \M^Pn-k-i)- This shows that for 
any |A| < 1 the function X{w) is the generating function of a vector x & l\. A 
similar reasoning shows that for any |A| < 1 the function X{w) in (3.8) is the 
generating function of a vector in £oo, thus proving that {A : |A| < 1} C ap{P). 

We conclude by showing that any A s.t. |A| = 1, A 7^ 1 lies in (Jc(-P). Indeed, take 
A = e*^ with < 6 <27T and assume that {XI — P*)x = for some x e ioo- Then 
the equation in (3.8) gives for the coefficients Xn the relation 
So, if x ^ 0, then p ■ x 7^ 0. Multiplying by pn and summing over n we then get 
1 = ^^PnC"**-"^"'"^-'^ which is impossible in our case. If the point A belongs to 
the unit circle and is different from A = 1, then the generating function X{w) in 
(3.7) tends to infinity as w approaches A~^ because D{w) ^ for any \w\ = 1. 
But if the solution x to the equation (A/ — P)x = belongs to £1, then the 
generating function X{w) is absolutely convergent at any point of the unit circle 
and its absolute value is bounded by |a;|i. We then see that the point A does 
not belong neither to ap{P*) nor to (Jp{P). This means that A e (Jc(-P)- In 
particular, we have found that the eigenvalue 1 is not isolated but is embedded 
in a continuous spectrum. 

III. Convergence properties. 

20 



Next, we discuss the convergence properties of this chain under the hypothesis 
that it is positive-recurrent. Note that the first part of statement III in Theorem 
2 is a consequence of Theorem 1, for |(i/P" — tt) • u| < \\i'P'^ — 7r||i • ||u||oo- 
Nevertheless, we shall give an alternative proof which on the one hand yields 
the actual asymptotic behaviour under the hypotheses stated in the second part 
of Theorem 2-III and on the other hand allows us to introduce a method which 
appears to be interesting in its own, for it may be extended to some more general 
(i.e. non-markovian) mixing Gibbs random fields [Isl]. 
For z eW, consider the matrix Lg given by 

/ PlZ P2Z psZ ...\ 
Piz'^ P2Z'^ PSZ'^ . . . 
= p-^z^ P2Z^ psZ^ . . . 

V ; ; ; / 

For z = 1 the matrix can be viewed as the transition matrix of the process 
Vq^^ , r[^^ ,.. . given by the sequence of times between returns to the state 1 (see 
(1.4)). The vector equation y — L^x, takes the generating function form Y{w) = 
p- l^i, X[z) where Y{w) — X^^^i VnW^ and 1^, = (w, ty^, , . . .)*. Therefore the 
power series of when acting on (-i^S) converges absolutely for any z in the 
closed unit disk \z\ < 1. In addition, there is a simple algebraic relation between 
the matrices and P: let Q be the transient chain given by the matrix 











•A 


1 













1 













1 













An easy calculation shows that 

{I-zQ){I-L,) = {I-zP). (3.10) 

This relation entails that if u is an eigenvector of P with eigenvalue 1/z, then 
V = u{I — zQ) is an eigenvector of with eigenvalue 1. On the other hand we 
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already know that P, when acting on £i, has spectral radius equal to 1 and no 
eigenvalues on the unit circle besides eventually 1. The choice z = 1 gives u = tt 
and V = 7r{I — Q) = ttiP, as expected. 

Let now u : S ^ Rhe a, bounded vector and v an initial distribution on S, which 
will be assumed to decay not slower than tt at infinity. The latter condition is 
equivalent to the assumption made in Theorem 1: if the P has ergodic degree 
d> then tt (u) has P-order (at least) d. 
Let us consider the following generating function, 



S(z) = J2^'' (^^"^ - tt) • u. 

n=0 

Using (3.10) we get for \z\ < 1, 

oo 

J] z^P^ • u = p{I - zP)-^ • u = zy(/ - L^)-^{I - zQ)-^ ■ u . 

n=0 

Now observe that v = {v-lz)p. Iterating n times we get v L'^ = (I'-lz) X^~^ p, 
with Az = p • Iz, and the above expression becomes 

(.•lz)p(/-.Q)-^-u^^^^_^^^_,^^^(.-lz)(m,7rz-u)^^^_^ 
1 — Xz 1 — Az 

where mi = tt^^ = D(l), = 1/(1 — zQ)~^ and tTz = Trip (/ — zQ)~^ (in 
particular 7rz\z=i = tt). Therefore a short manipulation yields the expression 

S{z) = (tt ■ u) (z/ ■ 1) H{z) + R{z) 



where 



H\z) = ; = 'no . , with e„ = > dh, 



and 



(miTT ■ u) (v ■ Iz - v ■ 1) + (i/ ■ Iz) (rniTTz ■ u - miTT • u) 
P(2) = + iyz-u. 

I — Az 
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Using the above and Lemma C one sees that if P has ergodic degree d then 
the coefficients of H{z) decay as tti e„ = Oe(n~'^). It remains to examine the 
behaviour of R{z). We have 

1 ~ V^^o 1 - ^k- 

1 - A. En=0 dnZ- 

Moreover, a straightforward calculation yields 

oo / oo 

n=0 \fc=l 

and therefore 

Tzr\ — x^oo — 1 — <;n — 2_^uk dk+n- 

In addition, 

oo oo 

v^-n^^-inZ^ with 7n = y^^Uki^n+k- 

n=0 k=l 

On the other hand, 

\in\ < \\u\\oo ^dk^ \\u\\oo e„, |7n| < ||wi|oo ^ ^k ^ ||w||oo?7n- 

k>n k>n 

Reasoning as in the proof of Lemma C we have that if |Cn| < oo then the 
coefficient of of the product ^'^^Q^nZ'^ ■ Yl^=o''^nZ'^ is 0(max{|^^|, 
(recall that Ui = 0(7ri)), otherwise it is 0(^„). Therefore, by the first estimate 
above, it is 0{en) in both cases. 

Comparing all the terms above and using again Lemma C we have found that 
under our assumptions on the distribution v and the vector u, the quantity 
(zvP" — tt) • u decays as Oe(n~'^). 

We conclude by deriving the exact asymptotic behaviour of {uP'^ — tt) ■ u under 
the additional hypotheses imposed in the last part of Theorem 2JII. First, if 
Pn ~ n"^''+^)L(n) then we have dn {d + l)~^n~^'^~^^^ L{n) and Cn ~ d~^{d + 
l)~^n~^ L{n). Lemma C then implies that the coefficients of the power series of 
H{z) are asymptotically equivalent to d~^{d + l)~^D{l)~^n~'^ L{n). Moreover, 
if Ui = o(l) and z/^ = o{7ri) then = o{en) and rjn = o(e„). Again by virtue of 
Lemma C this prevents from possible cancellations among the various coefficients 
introduced above and yields the claim. 
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APPENDIX. Renewal chains and Markov approximations of dynamical sys- 
tems. Let (X, p) be a probability space and f : X ^ X he a transformation 
preserving the probability measure p which we assume to be ergodic. Given a 
measurable subset E C X, the quantity 

_ p{Enf--E) 

^" " p{E) ^^-^^ 

is the probability to observe a return in E after n iterations of / (for the first 
time or not). The return time function 

REix) = mf{n > : /"(x) e E} {A.2) 

is defined (and finite) for a.e. x E E. E itself becomes a probability space with 
measure Pe{A) = p{A fl E)/p{E). One may then define the induced transfor- 
mation 

fE{x) ^ f'-^^^x) (A3) 

for a.e. x E E. Both Re and /e are measurable and in fact it is not difficult to 
check that /e preserves the measure pE which is of course ergodic. We denote 
by En = {x E E : Re{x) = n} the n-th levelset of Re- Notice that the above 
construction yields a countable partition A = {A^} of X into the sets 

and, p being /-invariant, 



p{An) = Y.p{Eu). (A5) 

fc>n 

Therefore we have 1 = p{X) = ^ p{An) = J2np{En). It hence follows that 

Pe{Re) = l/p{E), {A.6) 

which is a version of Kac's formula. Now notice that the number may be 
rewritten as 

en = PE{r''E). (A7) 
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This expression allows us to give another interpretation of e^- For x & E, let 
Sn{x) = Sfc=o be the total number of iterates of / needed to observe 

n returns to E and Nn{x) = Y^k^iXEif'^ix)) the number of returns up to the 
n-th iterate of /. A short reflection gives that psiSk < n) = Ylr=k PE{Nn = f)- 
In addition we have pE^Sk = n) = pE{Sk < n) — PEi.Sk < n — 1) for A; < n 
and pE^Sn = n) — pE{Sn ^ n). A straightforward computation using these 
observations and (A. 7) yields (for n > 0): 

n 

en = ^PE{Sk = n) ^ pEiNn) -pE{Nn-i), {A.8) 

k=l 

where pE{Nn) denotes the mean of the random variable Nn (we set A^o = 0). 
Thus, may be regarded as the expected number of returns in E per iteration of 
/ (after n iterations). It then turns out that the validity of the renewal theorem 
for Cn, that is [Se]: 

— r^-^, n-* oo (A.9) 
Pe{Re) 

is equivalent to the (self-)mixing property for the set E, that is e„ — > p{E). A 
further remark is the following. Let us decompose 



en = J]p£;(/(a^) iE,Q<l< k,f{x) e E,r{x) e E) 

k=l 

n 

= J2 PE{Ek) ■ PEirix) e E I Re{x) = k) 



(AlO) 



fc=i 

Now suppose that the process {f"'{x)} "renews" itself each time it returns to 
E. In other words, suppose that the random variables Re, Re o fE, Rr ° Sei • • • 
defined on the probability space {E,pe) are mutally independent. In this case 
we would have 

PEirix) e E, \REix) = k)= PEir-\x) eE) = en-k 

so that the e^'s would satisfy the recurrence equation 

1, 

0, for n > 0, 



■ 1, forn = 0, / /I iiN 

en -Pneo -Pn-iei pien-i = <f^ r (^-ll) 
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where pn = PE^En). This would make cq, ei, 62, . . . the renewal sequence asso- 
ciated to the sequence pi,P2, It has been observed [Fe2] (see also [Ki]) that 

any renewal sequence, that is any sequence generated as in (A. 11) withpi,p2 • • • 
satisfying Pn > and ^Pn < 1, can arise as the diagonal transition probabilites 
corresponding to a given state in some Markov chain. In our case, a Markov 
chain which does the job is precisely that discussed in Section 2, with the p^s as 
above and = Pii- Indeed, it is not difficult to realize that the Markov chain 
in question is that with transition probabilities 



and stationary distribution tTj = p{Ai), where the sets Ai are defined in (A. 4). 
We point out that under the supposition made above this Markov chain would 
be isomorphic (mod 0) to the iteration process {/"(x)}. On the other hand, in 



above Markov chain the Markov approximation of the dynamical system {X, p, /) 
w.r.t. the reference set E. Leaving any further detail of this approximation 
procedure to be discussed elsewhere [Isl], in particular the question of the choice 
of the reference set E and that of the "proximity" of {X, p, f) and its Markov 
approximation (see [Che] where this and related questions for a closely related 
approximation scheme have been dealt with in a far reaching way), we are now 
going to discuss a simple example (modelling temporal intermittency) where 
such an approximation is "exact", in that it is isomorphic to the dynamical 
system itself. 

Example. The Markov chain P studied in Section 2 is isomorphic (mod 0) to 
the iteration process of the piecewise affine 'intermittent' map / : [0, 1] [0, 1] 
given by 



Here the numbers di = are supposed to be all distinct, and cuj = Pi/pi-i, 

i > 1 (with po = 1). In what follows we shall always assume that J^^i < 00. 



Pij = p (Aj n / 



'A,)/p{A,) 



(A12) 



general the Re° 1% mutually independent and we are then led to call the 




(A13) 
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The partition A of [0, 1] into the intervals An — [dn, dn-i], n > 1 is a Markov 
partition for /. 

This map is named 'intermittent' for, if hma^ = 1, then / can be viewed as 
a piecewise affine approximation of a piecewise smooth transformation of [0, 1] 
which is expanding everywhere but at the fixed point in the origin, where the 
derivative is equal to one. 

Let ri, TT be as in the example of Section 2. One then sees that the map : 
0, — > [0, 1] defined by: 0(a;) = x according to f^{x) e A^., j > 0, is a bijection 
between f2 and the residual set of points in (0, 1] which are not preimages of 1 
w.r.t. the map /. Clearly (f) conjugates / with the shift r on Q. Moreover, let n 
be the r- invariant Markov probability measure on fl defined in (1.8) (with tt and 
P as above). Then p = o is /-invariant and it is easy to see that the 's 
are as in (^.4) — (^.12) with E = [di,do]. Finally, if / is the piecewise aflfine 
approximation of a smooth transformation of [0, 1] having a tangency at a; = 0"'' 
of order l + l/ry, withry > 0, thenpi ~ i-C^+v) and hence ctj ~ l — {l+r])/i. Thus, 
in order to have ^ (i^ < cxo it is necessary that ry > 1, and the corresponding 
Markov chain P has ergodic degree d — rj — 1. 

Let us consider the Perron-Frobenius operator M : I'^([0, l],dx) -£'^([0, l],dx) 
which satisfies 



for all pairs u,v e L^. Note that the space £i{S,p) of vectors u : JN ^ M such 
that 



\m\i,p '■= 2^ \ui\Pi < oo 



i€S 

is left invariant by the operator M, which takes on the matrix representation 

M{i,j) = ^P{i,j), i,j>l. (A15) 
Pj 

The eigenequation M h = h has a solution h G £i {S, p) given by hi — hi pi di-i/pi, 
and the vector p satisfies M*p = p. Therefore, recalling that tt, = TTidj-i, 
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and putting hi — ni/pi, we get ivi = hiPi. One then sees that the vector 
h e £i {S, p) corresponds to the (locally constant) density of the absolutely con- 
tinuous /-invariant probability measure p{dx) = h{x) dx, with h e -£'''^([0, 1], dx) 
and h{x) = hi for di < x < di-i. Observe that p{Ai) = TTj. Now, using (A. 14) 
we find 

p{u o p v) - p{u) p{v) = f u{x)[{lvrvh){x) - p{v)h{x)]dx (A16) 

Jo 

Suppose that u and v are bounded L^-functions taking constant values Ui and Vi 
on the elements Ai of the Markov partition A. We shall denote by u = {ui)°^i 
and V = (t'i)i^i the corresponding vectors in Ioq{M). Using (A. 15), (A. 16) and 
the above observations we get (the notation is as in the proof of Corollary 1), 

p{u o /" v) - p{u) p{v) = (ttvP" - (tt • v) tt) • u. (^.17) 

Now set ttoo = limttt, Vqq = limvj, and suppose that Uoo 7^ or Vqo 7^ 0. Then, 
setting u = u — ttool and v = v — VqoI have that (tt • u)(7r • v) 7^ provided 
TT ■ u Uoo and tt ■ v ^ Vqq. Moreover \imui = and lim^Oj = 0. On the other 
hand we plainly have (ttv — (tt • v) tt) ■ u = (ttv P"" — (tt • v) tt) • u. We then see 
that the conditions p{u) = tt • u 7^ and p{v) = tt • v 7^ Voo are equivalent to 
the conditions Ui = o(l) and Vi = o(7rj) (along with (tt ■ u){i' ■ 1) 7^ 0) assumed 
in the last statement of Theorem 2, with the identification u = ttv/tt ■ v. 
The following result is now a direct consequence of Theorem 2 (for related results 
see [Is2], [LSV], [Mo]; see also [Yo], [Isl] and [Sa] for more general approaches 
dealing with smooth maps): 

Corollary 2. Let / : [0,1] [0,1] he as in (A. 13) and assume that ai ~ 
1 — {l + r])/i for some i] > 1. Then, for any pair of bounded L^-functions 
u, V : [0, 1] M, locally constant on the Markov partition A, there is a positive 
constant C = C{u,v) such that, for n large enough, 

I p{u opv)- p{u) p{v) I < C n"^^-^) . 
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Assume furthermore that p{u) ^ Uqo and p{v) ^ Vqo- Then we have 

p{uo pv)- p{u)p{v) - Cn-^'^-^\ 

We conclude with a final remark. From the proof of Theorem 2 it follows that 
if the conditions p{u) 7^ Wqo and p{y) ^ v^o are violated, then cancellations may 
take place to accelerate the convergence rate. A trivial example is obtained by 
taking u,v constant on [0, 1]. Conversely, one may argue as follows: take a > 
and let ta{x) be the first entrance time into the set [a, 1]. When an orbit falls in 
a small (compared to a) neighbourhood of it stays there for a time which can 
be arbitrarily large before reaching again [a, 1]. More precisely, from the above 
discussion one readily finds that, under the assumptions of Corollary 2, 

p{x e [0, 1] : taix) > n} ~ C{a) n'^'^-'^l 

Thus, if the condition is satisfied, namely if the average value of the test functions 
is reached away from the origin, then the term p{uo v) cannot approach its 

asymptotic value p{u) p{v) at a rate faster than that given by the statistics of 
first entrance times given above. 
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